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(57) Abstract 

Digital audio and/or video programs that have been compressed on the basis of groups of pictures (GOPs) are recorded on a medium 
that allows immediate jumping between groups through co-storage of Transport Stream packets and pointer information. In particular, 
coexistently with the storing, successive pointers are derived in realtime from a primary Transport Stream that collectively point to data 
packets in a reconstructed Transport Stream, which contains entry points. These pointers are stored at predetermined locations on the 
medium. 
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BACKGROUND OF THE INVENTION 

CW , raetoVMtfOnre,ara,0 ame ^»^i»'l.e preamble of Claim 1. 

Cl*s.ca. v*. recording aHows .rick modes smb as fas, forward and fas, ^ ^ 
~* .have become more complex „ implement for digi[a) vMe0 ^ fe ^ 

° f PKmreS (GOP >' >— vide. intervals may correspond „ data 

US P T,T; n0n " U,,if0^,, la,g,hS> » "* — — « — video 

US Paten, 5.701.386 a,,ows fas, forward a„ d fas, reverse ov mvidiBg ^ „ ' 

flrSt °° P " d 2,80 bcfore its <*»■ Hereinafter, me term -picture- win * used 
_»,y. Depending on me actua, video stendard, me ^ . picture . 

to as weU as "field-. However, modem digiuu broadcast, in particular via satellite, 
uses Transport Streams (TS) according to system .aver standard ISO/IEC 13818-1 for 

2™^^' audio vwe °- ne vMe ° ,ayw — * «« « 

^ ° ^ B ° /IEC 138 »» ™« features are used inter 

alia for DVB and are intended for Itar p,ay wiu.on, feedback from a decoder. Packets 
amve a, a receiver one by one and their assignmen, to a particmar program is generaUy no, 
known, before me packet itsel, wiU have arrived: indeed, assignmen, is mrough PSI-tables 
R>r storage, one or more specific programs are selected from a received Transpor, Stream ' 
This w„> necessitate either a, spring time or a, replay time me adap,ing of cenain stream 
paranwiers for reuining a valid Transpor, Stream for replay. 

Replay systems will generally support jumping over a selectable physical 
aorage d^ce. but me probabimy of men hitting an entry point ,„ me actually stored 
prog™ is low. The finding of such emry poims will necessitate repeated and time intensive 
searches, which may cause buffer undertow. „ also becomes «ar,y impossible ,o replay the 
stream a, an n times higher speed with o integer, as well as ,o land immediacy on a video 
fragmen, ma, may be phyed independent m e ref ore , ,f storage takes place on a dedicated 
apparatus, me locations of me entry points must be immediate,y known, eimer directly or 
via pointers, me prob.em becomes more severe if a plurality „f program musl * aored 
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SUMMARY TO THE INVENTION 

In consequence, amongst other things, it is an object of the present 

" l ° T St ° red VidC0 * SUCh — ' Vari ° US «* — 
feastble for a Transpon Stream environment, whilst maintaining the data handling facilities 
5 proper to this environment. raciimes 

cha , • „ Now before, according to one of its aspects the invention is 
characterized according to the characterizing part of Claim 1 Th, in , 
m ^K«^ t . • 1116 mve ntion also relates to a 

method for rep.av.ng ^ recorded Wport Saammltoa » 

^ - fu^ aspect8 of te tovratjoii „ ^ h j^J 

BRIEF DESCRIPTION OF THE DRAWING 

These and further aspects and advantages of the invention will be 
dtscussed more ta deail hereinafter witt, reference » the disdosur. of preferred 
embodtments, and in particular with reference to the appended Figures ma. show: 

Figure 1, a block diagram of a recording organization; 

Hsnre 2, a diagram of a Transport Stream structure; 

Figure 3, a diagram of the stored data structure; 

Kgure 4, a block diagram of a replaying organization; 

Figure 5, packaging a Transport Stream; 

Figure 6, unpackaging a Transport Stream. 

STRUCTURAL DESCRIPTION OF A RELEVANT ENVIRONMENT 

According to their agreed upon format. Transport Stream Pack«s sart 
-U. a Transport Stream packet header, which contains a Packet IDentifier Pn>. Through the 

T b " mati ' m * *" — "> a packet wU, be known. 

The PH> , or ,b vtdeo data V.PID of each transmitted program is stored in the PSI utb.es in 
*e Transport Stream. A variable pay.oad.unit^art.indicator pusi is stored in the 
Tr^pon Stream packet header and indicates whemer the pavioad o, the packet in question 
*am mdeed „,th me f,rs, byte of a Packenzed Elememarv Stream PES packet (ISO/IEC 
^hdards supra). Fma.lv, the adap,a,ion.fle,d_con, ro , (afc) mdica^s whemer me Transport 
Stream packet contains indeed an adaptation field and/or a payload. 

PID-V Pm T0X " P ° taer ' ** SySKm USUaUy 0nly needs to — «"*- "»< have 
PID-V.PID, pus.=l and an afc ma, is either equal to 1 or equal to 3. !f the table wou.d be 
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«oo long f„, a single .88 byte pacta, two or more contiguous packets with PID=V PID 
must be access*. Only packets s0 signalled need be checked for presence of an ^ ^ 
Entry points may be as follows: 

• a TS packet with the start of an I-picture; 

• a TS packet with the start of a GOP; 

• a TS packet with the start of a sequence header. 

writ,, , „■ , '^ ne pointers may be transiently stored in RAM memory and eventually 
wntten to dtsc. A program with a video take lengm of 135 minutes with 25 picmres per 
second a 12 -picture GOP size and a pointer lengd, 0 , 4 bytes, w U1 produce about 0.54 Mbi, 

ITZTT mtom " u "'- A1 a 16 Mbaud writta * *» «* «" 

need about 35 nulltsecs, provide, they get a separate disc area. If RAM is «*, small the 
pomters must be written earlier. The pointers may be kept within the stored stream, such as 
by su.rtng ten when reaching a certein number such as 1000 selected packets. At ^y 

.5 iz^t::^^^^^^^^^ 

.5 may be used. !f the pointers are kept on a separate location, they may be written either after 
a certam fme interva,, or a. insta** when acma, bitrate is tew, or anyway before reaching 

ourrer storage capacity. 

The following further information may be stored with the pointers to 
facilitate the replay of a stored program: 

20 • the leng* in seconds of the video a. recording toe ,„ calc„,ating the remaining time- 

• srze of the GOPs, and if applicaWe, the characterization of the GOPs as being closed or 
non-closed. such as according «, MPEG-standard, and whether their sizes are uniform or 

not; 

• the PID of packets containing the Program Map Table PMT; 
25 • the PID of packets storing the Program Clock Reference PCR; 

• the PID of packets with video information; 

• Start Time Code that may be used to calculate elapsed time; 

• Frame Rate that in combination with a uniform GOP size may be used to jump to a 
particular instant in time; 

30 . the to*l number of TS packages which may be used ,0 calculate the end of the program in 

question; v 6 

• the overall numbers of I-, B- and P-pictures; 

• the total number of I-pictures; 
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• average bitrate. 

The use of Potato* ^ replaJ , tog Qf a 

higher speed. Transport Stream conditions shouM be mainlined b y avoiaing referencill6 
non-ex^t pictures. Further, certain fields may have ,„ be adapted. 

5 com,' •„ ■, TriCkPlayiS ^'^"V Smarting to a decoder only TS packets to 
contain vdeo Nation. tac.usive of SI ^ pcR ^ ^ 

sound » general* no, useful. The spring of extta information wU! allow to se.ec, for 
forwardmg exclusively those packe* to have a PID corresponding to to of PAT PMT 
PCR, and V.Pm. The GOP size information may be used for in a "non-Cosed- GcT' 
en_n,. during repiay of complex GOPs. selecably bypassing , particutar B-ptaure 
^.b y «o adap, TO referenres „ othw packagB ^ vHeo ^ 

1,5 " combinatio,, - - -* — * - «» >— -o ~ 

and d lspla y elapsed tlm , ^ of ^ ^ ^ a ^ ^ 

oTool L ' ^ ^ MOO. An extra advance 

of pomto-supported smrage is to a program need to be s W red only once. The described 
organ^on supports „ recording of a pluralny of programs in paral.e. in „ secondary 
Transport Sfream in an interleaved manner. In to case, each prog™, will need *s 

associated array of pointers. 

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS 

. Fi <^ lis a block diagram of an exemplary recording organization. Inpu, 

Z ~ 3 ^ l " «• —ion of the required TS packe* and time 

11™ r ^ fo "° Wed ^ " *-» Memory 24. In block 26, me 

*.e«ed TS packea are counted, and the conn, acnuUly attain* is forwarded to Potato Info 
Memory 28. In b,ock 32. entry points are e*ra«ed. and courted in b,„c k 3.: me conn, is 
fonvarded both to Potato Info Memory 28 and to Srream Info Memory 36 to is in fee. me 
same as block 24. In biock 34, me Time Code is relieved from the GOP header and if its 
value ,s zero, any necessary modification ma, be effected. In Mock 38, me Sto, Time Code 
« exacted for forwarding ,„ me Soeam Info Memory. In block 40, me GOP size arc! 
tan ^ taformauons are « and forwarded to Stream Info Memory, now biock 
SO. In block 42. the Cosed GOP Indicator is e*ra«ed, in Mock 44 me PCR PID, in block 
46 the PMT.PID. and in b,ock 48 the video PTD, a„ for Warding to «. SO e™ Info 
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Memory 50. The information on output 49 is ready for being stored. The Figure does not 
specify the mapping of various partial functionalities on proper hardware, which may be 
realized as conventional mechanisms that have not been shown for brevity. 

Figure 2 is a diagrammatical embodiment of the Transport Stream 
5 structure. Here, the uppermost level shows the sequence of Transport Stream Packets that 
each contain 188 bytes. On the next level a packet consists of a 4-Byte header that 
accommodates at least the informations PID, pusi and afc. The remainder is the TS-packet 
data. On the third level the data field may contain an adaptation field and/or a payload field 
that are sized according to need, and may be internally specified through the afc information. 

10 Figure 3 is a diagram of the stored data structure. Block 64 symbolizes 

the stream information formed by TS packets containing ail information that has been 
selected on the basis of the information stream received on input 22 in Figure 1. Block 62 
symbolizes the pointer information that has been produced by blocks 26, 30, 32 in Figure 1. 
Block 60 symbolizes the stream information produced by the various blocks in Figure 1, such 

IS as in particular blocks 22, 30, 38, 40, 42, 44, 46 and 48. Now, first the informations from 
blocks 60 and 62 are combined for contiguous storage. Next, the compound so formed, as 
well as the informations from block 64 are stored on the medium. The latter informations 
may be stored in physically distant locations from the former: the linking is through the file 
system. The overall information is collectively stored on disc in a format that may be 

20 configured along the exemplary teachings of Figure 2. During a program, TS packets will be 
written continually. Pointer and stream informations are being written either after termination 
of the video take, or in relatively small-sized amounts during the video take. 

Figure 4 is a block diagram of an exemplary replaying organization. Item 
70 represents the rewritable storage disc together with its associated electromechanical, 

25 electro-optical and electronic components for driving and information accessing, inclusive of 
demodulation, error correction and similar features that operate on a relatively lower 
organizational level than the present invention. Block 72 executes demultiplexing into three 
sub-streams. Block 74 symbolizes the Pointer Info Memory substream. Block 76 symbolizes 
the Stream Info Memory substream. These two streams are forwarded to control unit 80 that 

30 may execute the following user control functions: 

• setting the disc replay velocity, such as l...n times normal speed; 

• optionally, setting the minimum play duration before effecting a jump; here, various 
possibilities exist, such as play n GOPS before a jump, jump speed xn GOPs, or: play an I- 
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picture, repeat n times, then jump to the next I-picture, etcetera; 

• if a plurality of programs had been stored: program select; 

• setting the video start position where to start playing the program in question from; 

• play /record; 
5 • stop; 

• goto a specified point in time; 

• fast forward & fast reverse. 

Control functions are for example as follows: 

• display actually elapsed time from the start of the program that is being read out; 
10 • retrieving pointer and stream information from disc; 

• control goto operations to specific byte positions such as to access an entry point; 

• play as starting from a specified physical location; 

• record unto a specified physical location. 

The control unit may forward signals so developed along control lines 92, 
15 94, 96, 98 to various subsystems to be identified hereinafter. First, the disc-oriented 

subsystem 70 is controlled along line 92. The Transport Stream demultiplexed from block 72 

is forwarded to block 82 for extracting of the time code. Block 84 detects whether the 

indicator Closed-GOP is false (^1) and play n GOPs, replace first B-picture packets with 

null packets. Furthermore, block 84 detects whether the indicator Closed-GOP is false 
20 or play I-pictures only, update continuity counter in the TS packet header, update 

temporal reference in picture header, and set broken link in GOP header to 1, the latter 

depending on the decoder type. 

Block 86 detects whether replay speed 5*1, and in the positive case 

replaces all TS packets, except Video PID packets, PCR PID packets, PMT PID packets 
25 and PAT PED(0) packets with null packets. Furthermore, Presentation Time Stamp, 

Decoding Time Stamp, and PCR numbers are modified to reflect the correct presentation 

and decoding times. 

Block 88 detects whether there are timestamps or not; in the positive case, 

the Time Base is reconstructed and the Time Stamps removed. Output 90 will present an 
30 amended Transport Stream according to the MPEG-2 standard. For brevity, the Figure does 

not specify mapping various partial functionalities on hardware. 

A particular aspect of a Transport Stream is that all TS packets will start 

with a TS Header that contains a PID. 
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Figure 5 illustrates the packaging of a Transport Stream. At left, both 
video data and audio data arrive at their respective encoders 110 and 112. Both encoders then 
feed respective packetizers 112 and 116, respectively to produce a stream of video PES and 
a stream of audio PES. In multiplexer 118, the two streams are multiplexed to constitute an 
5 input Transport Stream that is ready for storage. 

Figure 6 illustrates unpackaging a Transport Stream. At left, a compound 
Transport Stream enters a demultiplexer annex decoder 120, that will separate video from 
audio. Block 126 is furthermore operative for clock extraction, and synchronizes video 
decoder blocks 122 and audio decoder block 124. The decoded video and audio informations 
10 are then available for consumer replay. 

Various relevant aspects of the invention are as follows: 

• The elapsed time indicator may be retrieved from the GOP-header and the Start Time 
Code and is independent from bitrate and GOP-size; 

• Fast forward and fast reverse are feasible at any speed, even if a single disc contains more 
programs in a physically, but not logically intermixed manner; 

• Both the pointer table and the TS information may be stored on an arbitrary disc location 
There is some kind of Table Of Contents that for all programs contains starting locations of 
the TS packets/program, of the pointer tables and of the TS information tables. 

• Trick play requires no extra regrouping or reformatting of the picture sequences; 
20 • External as well as an internal decoders may be used; 

• No explicit sector argument needed for TS-packets containing an entry point; 

• Data need not be stored in a physically contiguous manner; 

• Interleaved storage of audio, video and other data is allowed; 

• The invention allows all GOP-sizes, even non-uniform GOP-sizes. 



15 



WO 99/62251 PCT/IB99/00782 
CLAIMS: 



1 . A method for recording one or more digital audio and/or video programs 
that have been compressed on the basis of groups of pictures (GOPs), on a medium that 
allows immediate jumping between groups through co-storage of Transport Stream packets 
and pointer information, 

5 characterized by coexistently with said storing, in realtime deriving from a 

primary Transport Stream successive pointers that collectively point to data packets in a 
secondary Transport Stream that contains entry points, and which pointers are stored at 
predetermined locations on said medium. 

2. A method as claimed in Claim 1, wherein said predetermined locations 
10 are within said secondary Transport Stream. 

3. A method as claimed in Claim 1, wherein said predetermined locations 
are in a Table area outside said secondary Transport Stream. 

4. A method as claimed in Claim 1, for use with a plurality of interleaved 
programs in said secondary stream, whilst providing each such program with a privy array of 

15 pointers. 

5. A method as claimed in Claim 1, furthermore indicating a size of the 
GOPs, and if applicable, a characterization of the GOPs as being closed or non-closed, and 
whether their sizes are uniform or not. 

6. A method as claimed in Claim 1, furthermore indicating a PID of a 
20 packet containing a Program Map Table. 

7. A method as claimed in Claim 1, furthermore indicating a PID of a 
packet containing a Program Clock Reference. 

8. A method as claimed in Claim 1, furthermore indicating a PID of a 

/ 

packet that contains video information. 
25 9. A method as claimed in Claim 1, furthermore indicating a Start Time 

Code to be used to calculate elapsed time. 

10. A method as claimed in Claim 1, furthermore indicating a Frame Rate to 

be used in combination with a uniform GOP size to jump to a particular instant in time. 
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11. A method for replaying one or more digital audio and/or video programs 

built up with coded data that have been compressed on the basis of groups of pictures 
(GOPs), from a medium that allows immediate jumping between groups through stored 
Transport Stream packets and pointer information, 

characterized by accessing in an individual or compound Transport Stream 
bemg replayed, in realtime successive pointers that collectively point to data packets in a 

particular individual Transport Stream that contains entry points, by accessing such pointers 

at predetermined locations on said medium. 

12- A method as claimed in Claim 11, wherein said predetermined locations 
are within said secondary stream. 

13- A method as claimed in Claim 11, wherein said predetermined locations 
are in a Table area outside said secondary stream. 

14- A method as claimed in Claim 11, furthermore retrieving a Frame Rate 
indication for use in combination with a uniform GOP size to jump to a particular instant in 

tune. 

15. A recording device arranged for practising a method as claimed in Claim 

16- A replay device arranged for interfacing to information that has been 

recorded according to a method as claimed in Claim 1. 

17. A device as claimed in Claims 15 or 16, and arranged for interfacing to a 

rewritable disc. 
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(57) Abstract 

Digital audio and/or video programs that have been compressed on the basis of groups of pictures (GOPs) are recorded on a medium 
that allows immediate jumping between groups through co-storage of Transport Stream packets and pointer information. In particular, 
coexistently with the storing, successive pointers are derived in realtime from a primary Transport Stream that collectively point to data 
packets in a reconstructed Transport Stream, which contains entry points. These pointers are stored at predetermined locations on the 
medium. 
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